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A  random  image  can  therefore  be  modelled  by  a  collection  of  random  variables  Ua  located 
at  the  vertices  a  of  a  graph  G  ~  (V,  e).  Gibbs  distributions  have  been  used  to  specify  the 
distribution  of  random  images  because  the  graph  structure  G  can  be  tailored  to  take  into 
account  the  dependencies  intrinsic  to  the  structure  of  the  images  arising  in  practice. 

The  general  pattern  analysis  problem  can  be  broadly  described  as  follows.  There  is  a  true 
image  I  which  cannot  be  observed.  However,  a  deformed  version  Iv  of  I  can  be  observed. 
The  physical  process  deforming  the  true  image  /  is  due  to  the  process  of  observation  itself. 
This  physical  process  could  be  mathematically’  modelled  as  an  additive  noise  or  by  some 
other  process.  The  pattern  analysis  problem  is  to  reconstruct  the  true  image  I  based  on 
the  observed  image  Iv  by  using  a  statistical  procedure  that  is  optimal  in  some  sense. 

Bayesian  Image  analysis  first  formulates  a  prior  distribution  for  I  which  incorporates  what 
is  known  about  the  structure  of  the  true  image  /.  Gibbs  distributions  have  been  used  as 
prior  distributions  in  Bayesian  Image  analysis  [5j.  The  next  step  in  Bayesian  Image  analysis 
is  to  update  the  prior  notion  of  _r  using  Iv .  This  gives  rise  to  a  a  posterior  distribution 
on  the  set  of  images.  Under  fairly  general  conditions,  the  posterior  distribution  is  a  Gibbs 
distribution.  The  posterior  mean  or  the  posterior  mode  is  usually  used  as  an  estimate  of 
the  true  image  I. 

Bayesian  Image  analysis  has  had  a  good  deal  of  success  in  dealing  with  pattern  analytic 
problems.  The  HANDS  project  at  Brown  University  (8)  is  an  application  of  Bayesian 
Image  analysis  to  recognizing  biological  shapes  like  human  hands.  For  Bayesian  Image 
analysis,  it  is  necessary  to  generate  an  observation  from  the  posterior  distribution,  and 
this  is  commonly  done  using  the  Gibbs  Sampler  [5],  which  in  turn  uses  the  Metropolis 
algorithm  [9j.  In  fact,  we  can  simulate  observations  from  the  prior  distribution  using  the 
same  Gibbs  Sampler,  to  evaluate  its  suitability'  for  the  problem  at  hand.  This  is  called 
pattern  synthesis.  However  these  methods  are  not  very  fast  and  require  a  good  deal  of 
computer  time. 

A  natural  question  that  now  arises  is  whether  we  can  replace  simulations  with  direct 
mathematical  approximations  of  such  distributions  when  the  number  of  vertices  (  sites  ) 
of  the  graph  is  very  large.  The  answer  to  this  question  is  in  the  affirmative,  for  special 
graphs,  provided  that  the  number  of  vertices  increases  to  infinity  and  the  scale  of  gray 
levels  present  at  each  site  increases  at  a  certain  rate.  Results  that  describe  this  kind  of 
behavior  are  called  mixed  limit  theorems  and  have  been  studied  previously  by  Grenander 
and  Sethuraman  [7]  and  also  by  Chow  [4]. 

A  graph  of  interest  in  pattern  analysis  is  the  linear  connection  graph  Gj  defined  below. 
G\  has  vertex  set  {0,  ...,  n}  and  edge  set  {(i, i  +  1)  :  0  <  i  <  n). 

We  will  introduce  some  notation  in  order  to  state  the  mixed  limit  theorem  for  the  graph 
G i.  Let  A(-)  be  a  symmetric  density  and  Q(-)  be  a  density  function  on  3?.  Let  (U0. ...,  Un) 
which  reside  at  the  vertices  of  G\  have  a  joint  density  proportional  to 

n?-0U(v^(«.*+j  -  u,0) 

The  function  A  is  called  the  acceptor  function  in  the  pattern  analysis  literature.  The  accep¬ 
tor  function  models  the  local  dependence  between  the  U,-’s.  The  situation  when  the  local 
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dependence  specified  by  the  pattern  analytic  problem  at  hand  should  make  neighboring  Ui 
alike  can  be  modelled  by  taking  the  acceptor  function  A  to  be  a  symmetric  density  which 
is  decreasing  on  The  situation  when  the  local  dependence  should  make  neighboring 
s  different  can  be  modelled  by  taking  A  to  be  a  symmetric  density  which  has  bounded 
support  and  is  increasing  on  In  the  equation  above,  the  factor  of  y/n  represents  an 
increase  in  the  scale  of  gray  levels  present  at  each  site  as  alluded  to  earlier. 


Define 


X{  =  y/nUi 

and  Y{  =  X{  —  Xq,  i  —  0, . . . ,  n. 


1.1 


Note  that  Yo  =  0  and  that  the  distributions  of  the  X^s  do  depend  on  n.  We  shall  not 
explicitly  indicate  this  dependence  for  the  rest  of  this  paper.  The  case  when  A(-)  has  a 
second  moment  and  Q(x)  is  essentially  of  the  form  exp(— x2)  was  the  first  situation  to  be 
considered.  Mixed  limit  theorems  for  the  distribution  in  C[ 0, 1]  of  the  process  formed  by 
linearly  interpolating  the  X,-’s  have  been  derived  by  Chow  [4].  The  limiting  process  in 
this  case  is  a  Gaussian  process  with  a  known  covariance  function.  This  corresponds  to  the 
situation  in  which  the  acceptor  function  A  has  thin  tails.  The  case  where  the  acceptor 
function  A  has  thick  tails  is  the  situation  that  we  will  study  in  this  paper.  Let  A(-)  be  a 
stable  density  with  index  a,  0  <  a  <  2.  Then  A  has  thicker  than  normal  tails.  Theorem 
2.2  is  a  mixed  limit  theorem  for  the  distribution  of  a  family  of  stochastic  processes  on  [0, 1] 
based  on  the  X^s.  The  processes  that  we  will  study  are  related  to  the  stable  processes  (see 
Breiman  [10]).  Since  stable  processes  are  defined  on  the  space  D[0, 1],  this  is  the  natural 
topological  space  to  prove  distributional  limit  theorems  for  the  processes  under  study. 

Section  2. 

Construct  the  stochastic  processes  Gn(t)  and  Xn(t)  on  [0,  l]  as  follows: 

G„(t)  = 

The  random  variables  X{  and  Yi  are  as  defined  in  equation  (1.1).  The  processes  Xn(-)  and 
Gn(.)  are  random  variables  in  D[0, 1].  A  theorem  that  establishes  the  weak  convergence 
in  D[0, 1]  of  the  stochastic  processes  Gn(t )  and  Xn(t)  will  be  referred  to  as  a  mixed  limit 
theorem. 

For  the  rest  of  this  paper  we  shall  assume  that  Q(x )  =  exp(— x2)  and  that  A(-)  is  a 
symmetric  stable  density  of  index  a,  0  <  a  <  2. 

Let  fa(’)  denote  the  symmetric  stable  density  with  index  a.  Let  T0  have  density 
Then  /<*(■)  is  a  bounded  density  and  P{To  >  x)  ~  x°.  We  will  make  use  of  these  facts  in 
the  proof  of  Lemma  2.1. 

Now  (Xq,  Yi , ...,  yn)  has  a  joint  density  proportional  to 

n 

E£of<*(Vi+i  ~  y>)  exp(-n-1  ^(y,-  +  x0)2  -  x\/n).  (2.2) 

i=i 
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In  Theorem  2.1  we  will  show  that  Gn(-)  converges  weakly  to  a  process  G(-)  in  I? [0,1]. 
Corollary  2.1  of  this  theorem  will  show  that  An(i)  will  also  converge  weakly  in  £[0,  l]  to 
the  same  process  G(-). 

The  method  of  proof  of  Theorem  2.1  is  as  follows.  We  will  show  that  the  distribution 
of  G„(-)  conditional  on  Xq  =  xo  converges  weakly  in  £[0,1].  We  then  show  that  the 
distribution  of  X0  converges  strongly  on  3?.  A  result  of  Sethuraman  [3]  which  is  stated 
as  Lemma  2.2  in  the  proof  of  Theorem  2.1  will  establish  the  weak  convergence  of  Gn(-). 
Lemma  2.1  is  a  weak  convergence  result  for  stable  laws  which  will  be  used  in  the  proof  of 
Theorem  2.2. 

Let  A*  and  Y  be  random  variables.  Then  X  =  Y  denotes  that  A'  and  Y  are  equal  in 
distribution.  Let  {A-,,,  n  =  1,...}  be  a  sequence  of  random  variables  on  a  complete 
separable  metric  space  5  and  let  X  and  A0  be  random  variables  in  5  .  Then  Afn-^+  X  denotes 
that  C(Xn)  converges  weakly  to  C(X)  in  S.  C(Xn\X$  =  xo)  denotes  the  conditional 
distribution  of  (Xn  given  that  Ao  =  Xo).  Let  R(t)  be  a  stationary  and  independent 

increment  process  in  Z?[0, 1]  with  R(t )  =  Lemma  2.1  below  explicitly  constructs 

such  a  process  £(•)  in  £>[0, 1]. 

Lemma  2.1 

Let  0  <  a  <  2  and  let  To,T\,.. .  be  i.  i.  d.  with  density  fQ.  Consider  the  partial  sums 

f 

S{  =  Tj,  i  =  1, 2, . . . ,  So  =  0  and  let  the  process  (Hn(<),  0  <  t  <  1)  be  defined  by 
3- 1 

£n(t)  =  n-1/°S[nl]. 


Then:  Rn(.)  -2U  R(.)  in  D[ 0, 1]. 

Proof 

The  method  of  proof  is  the  usual  one,  i.e.,  we  shall  first  prove  finite-dimensional  convergence 
and  then  verify  the  appropriate  tightness  conditions. 

Let  us  calculate  the  characteristic  function  of  Rn(t),t  €  [0,1]. 

=  E(exp(iuR(t))) 

=  E{exp{iun~1/Q  r/))  (2.3) 

=  exp(-|u|adn(t)) 

where  dn(t)  =  — +  1 as  n  -+  oo  for  t  6  [0,  lj. 

Let  <0  =  0  <  <i  <  •••  <  tk  <  tk+ 1  =  1,  and  let  /0(-)  be  the  symmetric  stable  density  with 
index  a. 

Let 

A't>  =  Rn(U)-  Rn(ti-i),  l<i<k  +  l,  n  =  1,2,... 
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Note  that  {Xj.n,  *  =  1,  . . . ,  k  +  1}  axe  mutually  independent  random  variables.  Let 
be  the  density  of  XijU.  Then  by  (2.3)  it  is  clear  that  /,-|n  is  given  by 

/,>(*)  =  /« ( _  *y_i)  ) 


Since  Xi,n  are  mutually  independent  and  Rn(ti)  =  i 

3=0 

of  •  • , Rn(tk))  is  given  by 


1,  . . . ,  k  +  1,  the  density 


This  density  converges  to  the  density  of  •  •  •  ,iZ(ty-)).  Hence  the  finite  dimensional 

distributions  converge.  We  will  verify  tightness  next. 

Let  0  =  <o  <  <  *2  <  ^3  <  ty  =  15  e  >  0  and  let  U,  V  be  stable  symmetric  random 

variables  with  index  or.  Then  by  the  mutual  independence  of  the  increments  Xi<n,  and  the 
facts  about  the  tail  probabilities  of  stable  symmetric  random  variables,  it  follows  that 


=  P{\Rn(h )  -  Rn(t2)\  >  e]  •  P{|*»(*a)  -  Rn(ti)\  >  e} 

=  P{\U\> 


< 


M-iU-ttf 


c2a 


Using  Theorem  (15.6)  in  Billingsley  [1],  tightness  of  the  distributions  is  immediate.  This 
proves  the  lemma.  □ 

Define  v(xo,x),  /(«)  and  fi(u)  as  follows 


u(x0,x)  =  exp(—  J  (x(t)  +  x0)2 dt)  (^J  exp {— J  (r(i)  +  z0  )2dt)dP(x)j 

/(«)  =  f  exp(—  f  (x(t)  +  u)2dt)dP(x) 
ir>fo.ii  Jo 


-/(«)/  f  f(y)dy. 

J  9? 


Note  The  finiteness  of  these  integrals  becomes  clear  in  the  proof  of  Theorem  2.1  below. 

In  order  to  state  the  mixed  limit  theorem  for  Gn  we  introduce  the  following  notation. 

Let  Qn  —  £(Gn),  Pn  =  C(Rn),  P  =  C(R).  For  r0  in  &  let  Qn>x0  =  £(G„ |X0  =  zo)-  These 
are  probability  measures  on  D[0, 1]. 
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Theorem  2.1 


Let  A(-)  be  a  stable  density  of  index  a,  0  <  a  <  2.  Then  Qn  converges  to  Q  weakly  in 
D(0,  l]  where  the  density  of  Q  is  given  by 


dQ(x)  = 


exP(~  Jo(g(<)  ~  jj  f(u)duydt) 

Idiom  exp(~  So1  ~  So1  x(u)du)2dt) dP(x) 


dP(x). 


Proof 


If  we  omit  the  exponential  term  in  (2.2),  then  <?„(•)  and  Rn(-)  have  the  same  distribution. 
To  stud}’  Qn i  we  shall  first  show  that  Qn, Xo  converges  weakly  in  D[0, 1}.  We  will  then  show 
that  the  densities  of  X0  converge.  This  proves  strong  convergence  for  the  densities  of  Aro 
via  Scheffe’s  theorem  [2].  This  will  prove  a  weak  convergence  result  for  the  distribution  of 
Qn{’)  on  D[0, 1],  via  a  result  of  Sethuraman  [3]  stated  below. 

Lemma  2.2 

Let  An  be  a  sequence  of  probability  measures  on  V  x  W  where  V  and  W  axe  topological 
spaces.  Let  be  the  marginal  distribution  of  An  on  V  and  u„ (v,  •)  be  the  conditional  p. 
m.  of  An  on  W.  Suppose  that  jin(A)  — >  jx(A)  VA  C  V  and  un(v,-)  — ►  i/(u,-),  weakly  for 
almost  all  v  (w.  r.  t  n).  Then,  An  — *  A  weakly  where 

A  (A  x  B)  =  J  v(v,B)  dfi(v) 


for  each  measurable  rectangle  A  x  B  6  V  x  W. 

We  shall  apply  this  theorem  where  W  =  I?[0.  l],  V  =  3?,  is  the  distribution  of  Ao,  and 

=  Zo)- 

We  will  now  show  the  weak  convergence  of  ^(QnOI-^ci  =  2:0)  by  considering  it’s  Radon- 
Nikodym  derivative  with  respect  to  Pn  and  using  the  fact  that  Pn-— >P.  We  shall  denote 


a  function  x(-)  in  £?[0,l]  by  x  from  now  on.  Let 


dQn^zo 
dP n 


(x)  denote  the  Radon-Nikodym 


derivative  of  Qn, i0  with  respect  to  Pn(-)  at  z  for  x  in  J9[0, 1].  For  x  in  £>[0,  l]  let 


Then 


T  4 

kn(x)  =  exp(-n“1  ^(x(i/n)  +  x0)2) 
1  =  1 

and  fc(x)  =  exp(—  f  (x(t)  +  x0)7dt). 

Jo 


dQ  n. 


dP, 


jT^x)  =  *„(*)/  f  kn(y)dPn(y). 

n  */D[0,l] 
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Let  /  be  a  bounded  continuous  function  from  D[0, 1]  to  3?.  Then 


/  f(x)dQn, I0  =  f  f(x)kn{x)dPn/  f  kn(x)dPn. 

Jd\ 0,1)  ^D(o,i)  '  JD\0,1] 

The  weak  convergence  of  Qn,x0  wiU  be  proved  by  showing  that 

[  f(x)kn(x)dPn(x)  — ►  f  f(x)k(x)dP(x)  and 

iD[0,l]  -/Z?[0,1] 

J  kn(x)dPn(x )  — ►  [  k(x)dP(x). 

J  D[0,1)  J  D\ 0,1] 


This  will  prove  that  Qn,x0—~*Qx.  and  that 

“tetOO  =  fc(x)/  f  Hv)dP(y). 

Lemma  2.3  will  help  us  to  verify  this. 

Lemma  2.3 

Let  /  :  &  — ►  3?  be  continuous  and  xn  — ►  x  6  -D[0, 1].  Then, 


n  1^/(x"(i/n)) 

1=1 


(2.4) 


(2.5) 


Proof 

Without  loss  of  generality,  we  can  assume  that  /(x)  =  x  since  the  map  x  — ►  /(x)  induced 
on  ,D[0, 1]  by  /  is  a  continuous  map  from  I?[0,  l]  — ►  I?[0, 1].  Hence,  it  suffices  to  show  that 


"  f1 

n-1  ^^xn(i/n)  — *•  /  x(t)  dt. 

«= i  do 


Let  us  define 


(  xn(ijn )  if  (t  —  l)/n  <  t  <  i/n 
t,  xn(0)  if  f  =  0. 


n  ,1 

Then,  n-1  x„(i/n)  =  /  yn(t)dt.  Since  xn  — ►  x  in  D[0,  l], there  exist  An  which  are 

,=i  Jo 

strictly  increasing,  continuous  and  surjective  mappings  of  [0,  l]  — *  [0,  l))  such  that 


£n(An(0)  x(0  uniformly  in  t 

and  An(t)  — +  t  uniformly  in  t. 
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Let  ^  €  (0,1]  be  a  continuity  point  of  x(-).  The  following  argument  shows  that  yn(s)  — * 
x(s). 

Theie  exists  in  such  that  ( in  -  1  )/n  <  s  <  tn/n.  Let  s*  =  A ^(t'n/n).  Then  yn(s)  = 
Xn(^n^n}‘  Hence 

\yn(s)  -  x(«)|  <  |xn(An.s* )  -  1(5;)]  +  | x(s'n)  -  x(s)| 

<  sup  |x„(Ant)  -  x(f)|  +  |x(s*)  -  x(s)|.  ^2-') 

*€[0.1] 

Now  ij  -*  j  and  since  5  is  a  continuity  point  of  x(-),  |x(s*)  —  x(s)|  — ►  0  as  n  — ♦  00.  The 
first  term  in  (2.7)  converges  to  0  by  (2.6).  Hence  yn(s )  — ►  x(s),  as  asserted.  Since  the 
number  of  discontinuity  points  of  x(-)  is  countable,  yn(s )  — »  x(s)  a.  s.  (Lebesgue).  By  the 
Dominated  Convergence  Theorem,  and  because  xn  and  hence  yn  are  uniformly  bounded, 


f  yn(t)dt  -f  f  x(t)dt. 

Jo  Jo 


This  proves  Lemma  2.3.  □ 


Hence  it  follows  that 


n  J  x2(t)dt  and 

n~l  xn{i/n)  — *  /  x(t)dt. 

'  J  0 


Thus  exp(— n"1  X)”=1(x(i/n)  +  x0)2)  — ►  exp(—  /^(x^)  -f  x0)2dt)  By  (2.S)  since  exp(— t)  is 
a  bounded  continuous  function  on  [0,oo],  kn(xn)  —*  k(x)  and  f(xn)kn(xn)  — ►  /(x)fc(x)  as 
xn  — »  x  in  D  O,  1].  Also  note  that  kn(x)  and  k(x)  are  bounded. 

Then  by  using  Theorem  5.5  of  Billingsley  [l]  it  follows  that  both  terms  in  (2.5)  converge 
as  stated. 

Thua  Qn,x0-^Qxo  as  n  — ►  00  and 


dQx  0 
dP 


=  exp(-/  (x(t)  +  x0)2dt)(  [  exp (-  /  (x(t)  +  x0)2dt)dP(x)\ 
Jo  vd[o,i]  Jo  J 


—  u(x0,  x). 


Now,  we  will  show  that  the  distribution  of  A'o  converges  strongly  by  using  Scheffe’s  theorem 


Define 


r  n 

fn(x 0)  =  exp(— Xg/n)  /  exp(— n-1  VYi^'/n)  +  x0)2)dP„(x). 

JD[  0,1]  T~, 


Then,  the  density  of  A'o  is  given  by  fn(x 0) 
f„(x 0)  — ♦  f(x 0)  as  n  —v  00  where 


/n(x0)dxo.  By  (2.5)  we  know  that 


/(x0)=  [  exp (—  /  (x(t)  +  x0)2dt)dP(x). 

iD[o,i]  Jo 


(2.10) 
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In  order  to  sucessfully  apply  Scheffe’s  theorem,  we  need  to  check  that  f#  fn(x0)dx0  —> 
Jdtf(x0)dx0. 

By  Fubini’s  Theorem  and  elementary  algebra  we  know  that 


r  r  n 

f  fn(x0)dx0=  /  exp(-xjj/n)  f  eyp(-n_1  V(x(i/n)  +  x0)2)dPn(x)dx0 
Jx  Jx  JD[  0,11  i= 1 

.=  /  ex'p(-'n"1  E  +  (Kn  + 1)]-1  E  x({/n))2) 

JD[0,1\  '  1=1  i=!  ' 

r  n 

x  I  exp(-n/(n  +  l)(x0  -  [n(n  +  l)]-1  ^x(i'/n))2^dx0  dPn(x ) 

■'*  •  i=i 

— *  \pK  [  expf—  f  x2(t)dt  +  (  f  x(t)dt)7^\dP(x). 

JD[  0,1)  'Jo  Jo  '  ■  . 

This  limit  is  equal  to  f(xo)dx0,  because 

f  f(xo)dx0=  f  f  exp(—  f  (x(i)  +  x0)2dt)dP(x)dx0 

Jx  jkJd[  0,11  Jo  (2  11) 

=  yfn  f  expf—  f  x2(t)dt+(f  x(t)dt)2^\dP(x). 

J  oro.ii  'Jo  Jo  J 


Thus  the  distribution  of  Xo  converges  strongly  to  a  distribution  with  density  function  given 

by 


d/i(x0)  =  f(x0) 


f(x0)dx0. 


(2.12) 


Hence,  by  Lemma  2.2  it  follows  that  Qn  converges  weakly  to  a  distribution  Q  on  D[ 0,  l] 
with  density  given  by 


dQ(x)  =  ( f  ,/(I-I°)<MI°))'1'P(1)- 


(2.13) 


The  integral  in  (2.13)  can  be  further  simplified  by  using  (2.10)  and  (2.11). 


L 


v(xo,x)dfi(xo) 


/jRex P(~  loW)  +  xpYdtJdx o 
Sxf(x0)dx0 


_  exP(-/o1(x(0  -  Jo  x(u)du)2dt) 

Jz?[0,i]  exp(“  Jo  (x(0  -  Jo  x(u)du)2dt)dP(x) 

This  completes  the  proof  of  Theorem  2.1  □ 

The  following  corollary  is  a  mixed  limit  theorem  for  Xn(t).  This  shows  that  mixed  limit 
theorems  exist  for  the  stable  case  and  the  limits  are  Gibbs  distributions. 
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Corollary  2.1 


A'n(f)  converges  weakly  in  JD[0,  l]  to  the  process  G(-)  which  has  distribution  Q. 


Proof 

Since  A'n(t)  =  A'o  +  G„(i),  0  <  a  <  2,  and  the  distributions  of  A'o  converge 

strongly  as  n  — >  co  it  follows  from  Slutsky’s  Theorem  that  the  distributions  of  A'n(-) 
converges  weakly  in  £)(0,  l]  to  £?(•).  □ 

Remark.  The  next  problem  that  has  to  be  addressed  is  that  of  explicitly  evaluating  the 
integral  /D-0  j,  exp(—  f*(x(t)  —  x(u)du)2dt)dP(x).  This  will  be  necessary  in  order  to 
simulate  observations  from  the  limiting  distribution  Q. 
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